Feature: Book Genie Mode - Automated Testing with Detailed Reporting
File name: BookGenie.feature
Relative path: features/BookGenie.feature
Scenario Outline: Book Genie Response Validation with Citation Verification
When
I open the Creative Workspace login page
00:00:09.069
Then
I should see the homepage
00:00:00.058
When
I click on the mode selection dropdown
00:00:00.000
Then
I can see the "BookGenieQA" mode
00:00:00.000
And
I select the "BookGenieQA" mode
00:00:00.000
Then
I type "Suggest 5 books on christmas" on chat input element
00:00:31.162
And
I wait for AI to complete thinking
00:00:08.522
And
I validate the response is visible for "Suggest 5 books on christmas"
00:00:00.009
And
I extract book data from BookGenie response
00:00:00.009
And
I save BookGenie book data to Excel file for query "Suggest 5 books on christmas"
00:00:00.000
+ Show Error
Error: No book data extracted from BookGenie response.
at CustomWorld.(anonymous) (/home/runner/work/HC_Epub_Automation/HC_Epub_Automation/tests/steps/bookGenie.step.ts:46:15)
at /home/runner/work/HC_Epub_Automation/HC_Epub_Automation/tests/steps/bookGenie.step.ts:8:71
at __awaiter (/home/runner/work/HC_Epub_Automation/HC_Epub_Automation/tests/steps/bookGenie.step.ts:4:12)
at CustomWorld.(anonymous) (/home/runner/work/HC_Epub_Automation/HC_Epub_Automation/tests/steps/bookGenie.step.ts:59:12)
And
I validate each book individually against Excel file for query "Suggest 5 books on christmas"
0s
And
I validate that reason texts match citation texts with 80% similarity
0s
And
I generate detailed citation validation report
0s
Then
I verify database connectivity
0s
And
database should contain 10032 books
0s
And
I validate extracted books individually against database
0s
And
I validate BookGenie response relevance with AI for query "Suggest 5 books on christmas"
0s
=== SCENARIO LOGS: Book Genie Response Validation with Citation Verification === [1:08:06 PM] Navigating to Creative Workspace login page [1:08:15 PM] Homepage visibility: false [1:08:16 PM] ℹ️ Typing query: "Suggest 5 books on christmas" [1:08:46 PM] ⚠ ⚠Book Genie mode did not loaded [1:08:46 PM] ℹ️ Preparing to type query: "Suggest 5 books on christmas" [1:08:46 PM] ℹ️ Waiting for chat input to be visible [1:08:46 PM] ℹ️ Clearing chat input [1:08:46 PM] ℹ️ Typing query: "Suggest 5 books on christmas" [1:08:47 PM] ℹ️ Pressing Enter to submit query [1:08:47 PM] ✅ Query submitted successfully: "Suggest 5 books on christmas" [1:08:47 PM] ℹ️ Waiting for AI to complete thinking... [1:08:47 PM] 📋 WAITING FOR AI RESPONSE [1:08:47 PM] ℹ️ Looking for AI thinking indicator... [1:08:47 PM] ℹ️ Waiting for thinking indicator to appear (max 2 minutes) [1:08:49 PM] ✅ ✓ AI thinking indicator appeared - AI is processing the request [1:08:49 PM] ℹ️ Waiting for thinking indicator to disappear (max 5 minutes) [1:08:52 PM] ✅ ✓ AI thinking completed - Response should be ready [1:08:52 PM] ℹ️ 🔍 Checking for "None of the above, just" option... [1:08:52 PM] ℹ️ ✓ "None of the above, just" option not present - proceeding normally [1:08:52 PM] ℹ️ Allowing additional time for response rendering [1:08:55 PM] ✅ AI response wait process completed [1:08:55 PM] ℹ️ Validating response for query: "Suggest 5 books on christmas" [1:08:55 PM] 📋 VALIDATING RESPONSE FOR QUERY: "Suggest 5 books on christmas" [1:08:55 PM] ℹ️ Locating the latest response in chat [1:08:55 PM] ℹ️ Waiting for response to be visible (max 30 seconds) [1:08:55 PM] ✅ Response received - Length: 32 characters [1:08:55 PM] ℹ️ Response preview: Watch Me Work✅ Request Processed... [1:08:55 PM] ℹ️ Extracting book data from response... [1:08:55 PM] 📋 EXTRACTING BOOK DATA FROM RESPONSE [1:08:55 PM] ℹ️ Locating BookGenie response container [1:08:55 PM] ℹ️ Extracting HTML content from response [1:08:55 PM] ℹ️ HTML content extracted - Length: 4371 characters [1:08:55 PM] ℹ️ Parsing HTML to extract book data [1:08:55 PM] ✅ SUCCESSFULLY EXTRACTED 0 BOOKS [1:08:55 PM] 📋 EXTRACTED BOOKS SUMMARY [1:08:55 PM] 📊 Total books extracted: 0 [1:08:55 PM] 📊 Average relevance score: 0% [1:08:55 PM] ✅ Extracted 0 books from response === END LOGS ===
Scenario Logs: Book Genie Response Validation with Citation Verification
[1:08:06 PM] Navigating to Creative Workspace login page
[1:08:15 PM] Homepage visibility: false
[1:08:16 PM] ℹ️ Typing query: "Suggest 5 books on christmas"
[1:08:46 PM] ⚠ ⚠Book Genie mode did not loaded
[1:08:46 PM] ℹ️ Preparing to type query: "Suggest 5 books on christmas"
[1:08:46 PM] ℹ️ Waiting for chat input to be visible
[1:08:46 PM] ℹ️ Clearing chat input
[1:08:46 PM] ℹ️ Typing query: "Suggest 5 books on christmas"
[1:08:47 PM] ℹ️ Pressing Enter to submit query
[1:08:47 PM] ✅ Query submitted successfully: "Suggest 5 books on christmas"
[1:08:47 PM] ℹ️ Waiting for AI to complete thinking...
[1:08:47 PM] 📋 WAITING FOR AI RESPONSE
[1:08:47 PM] ℹ️ Looking for AI thinking indicator...
[1:08:47 PM] ℹ️ Waiting for thinking indicator to appear (max 2 minutes)
[1:08:49 PM] ✅ ✓ AI thinking indicator appeared - AI is processing the request
[1:08:49 PM] ℹ️ Waiting for thinking indicator to disappear (max 5 minutes)
[1:08:52 PM] ✅ ✓ AI thinking completed - Response should be ready
[1:08:52 PM] ℹ️ 🔍 Checking for "None of the above, just" option...
[1:08:52 PM] ℹ️ ✓ "None of the above, just" option not present - proceeding normally
[1:08:52 PM] ℹ️ Allowing additional time for response rendering
[1:08:55 PM] ✅ AI response wait process completed
[1:08:55 PM] ℹ️ Validating response for query: "Suggest 5 books on christmas"
[1:08:55 PM] 📋 VALIDATING RESPONSE FOR QUERY: "Suggest 5 books on christmas"
[1:08:55 PM] ℹ️ Locating the latest response in chat
[1:08:55 PM] ℹ️ Waiting for response to be visible (max 30 seconds)
[1:08:55 PM] ✅ Response received - Length: 32 characters
[1:08:55 PM] ℹ️ Response preview: Watch Me Work✅ Request Processed...
[1:08:55 PM] ℹ️ Extracting book data from response...
[1:08:55 PM] 📋 EXTRACTING BOOK DATA FROM RESPONSE
[1:08:55 PM] ℹ️ Locating BookGenie response container
[1:08:55 PM] ℹ️ Extracting HTML content from response
[1:08:55 PM] ℹ️ HTML content extracted - Length: 4371 characters
[1:08:55 PM] ℹ️ Parsing HTML to extract book data
[1:08:55 PM] ✅ SUCCESSFULLY EXTRACTED 0 BOOKS
[1:08:55 PM] 📋 EXTRACTED BOOKS SUMMARY
[1:08:55 PM] 📊 Total books extracted: 0
[1:08:55 PM] 📊 Average relevance score: 0%
[1:08:55 PM] ✅ Extracted 0 books from response
Scenario Outline: Book Genie Response Validation with Citation Verification
When
I open the Creative Workspace login page
00:00:03.217
Then
I should see the homepage
00:00:00.032
When
I click on the mode selection dropdown
00:00:00.000
Then
I can see the "BookGenieQA" mode
00:00:00.000
And
I select the "BookGenieQA" mode
00:00:00.000
Then
I type "Suggest 3 books for childrens" on chat input element
00:00:31.143
And
I wait for AI to complete thinking
00:00:21.053
And
I validate the response is visible for "Suggest 3 books for childrens"
00:00:00.006
And
I extract book data from BookGenie response
00:00:00.006
And
I save BookGenie book data to Excel file for query "Suggest 3 books for childrens"
00:00:00.000
+ Show Error
Error: No book data extracted from BookGenie response.
at CustomWorld.(anonymous) (/home/runner/work/HC_Epub_Automation/HC_Epub_Automation/tests/steps/bookGenie.step.ts:46:15)
at /home/runner/work/HC_Epub_Automation/HC_Epub_Automation/tests/steps/bookGenie.step.ts:8:71
at __awaiter (/home/runner/work/HC_Epub_Automation/HC_Epub_Automation/tests/steps/bookGenie.step.ts:4:12)
at CustomWorld.(anonymous) (/home/runner/work/HC_Epub_Automation/HC_Epub_Automation/tests/steps/bookGenie.step.ts:59:12)
And
I validate each book individually against Excel file for query "Suggest 3 books for childrens"
0s
And
I validate that reason texts match citation texts with 80% similarity
0s
And
I generate detailed citation validation report
0s
Then
I verify database connectivity
0s
And
database should contain 10032 books
0s
And
I validate extracted books individually against database
0s
And
I validate BookGenie response relevance with AI for query "Suggest 3 books for childrens"
0s
=== SCENARIO LOGS: Book Genie Response Validation with Citation Verification === [1:09:00 PM] Navigating to Creative Workspace login page [1:09:04 PM] Homepage visibility: false [1:09:04 PM] ℹ️ Typing query: "Suggest 3 books for childrens" [1:09:34 PM] ⚠ ⚠Book Genie mode did not loaded [1:09:34 PM] ℹ️ Preparing to type query: "Suggest 3 books for childrens" [1:09:34 PM] ℹ️ Waiting for chat input to be visible [1:09:34 PM] ℹ️ Clearing chat input [1:09:34 PM] ℹ️ Typing query: "Suggest 3 books for childrens" [1:09:35 PM] ℹ️ Pressing Enter to submit query [1:09:35 PM] ✅ Query submitted successfully: "Suggest 3 books for childrens" [1:09:35 PM] ℹ️ Waiting for AI to complete thinking... [1:09:35 PM] 📋 WAITING FOR AI RESPONSE [1:09:35 PM] ℹ️ Looking for AI thinking indicator... [1:09:35 PM] ℹ️ Waiting for thinking indicator to appear (max 2 minutes) [1:09:37 PM] ✅ ✓ AI thinking indicator appeared - AI is processing the request [1:09:37 PM] ℹ️ Waiting for thinking indicator to disappear (max 5 minutes) [1:09:53 PM] ✅ ✓ AI thinking completed - Response should be ready [1:09:53 PM] ℹ️ 🔍 Checking for "None of the above, just" option... [1:09:53 PM] ℹ️ ✓ "None of the above, just" option not present - proceeding normally [1:09:53 PM] ℹ️ Allowing additional time for response rendering [1:09:56 PM] ✅ AI response wait process completed [1:09:56 PM] ℹ️ Validating response for query: "Suggest 3 books for childrens" [1:09:56 PM] 📋 VALIDATING RESPONSE FOR QUERY: "Suggest 3 books for childrens" [1:09:56 PM] ℹ️ Locating the latest response in chat [1:09:56 PM] ℹ️ Waiting for response to be visible (max 30 seconds) [1:09:56 PM] ✅ Response received - Length: 90 characters [1:09:56 PM] ℹ️ Response preview: Watch Me Work✅ Request Processed🚀 Switching to BookGenieSure. Opening the BookGenie mode.... [1:09:56 PM] ℹ️ Extracting book data from response... [1:09:56 PM] 📋 EXTRACTING BOOK DATA FROM RESPONSE [1:09:56 PM] ℹ️ Locating BookGenie response container [1:09:56 PM] ℹ️ Extracting HTML content from response [1:09:56 PM] ℹ️ HTML content extracted - Length: 5823 characters [1:09:56 PM] ℹ️ Parsing HTML to extract book data [1:09:56 PM] ✅ SUCCESSFULLY EXTRACTED 0 BOOKS [1:09:56 PM] 📋 EXTRACTED BOOKS SUMMARY [1:09:56 PM] 📊 Total books extracted: 0 [1:09:56 PM] 📊 Average relevance score: 0% [1:09:56 PM] ✅ Extracted 0 books from response === END LOGS ===
Scenario Logs: Book Genie Response Validation with Citation Verification
[1:09:00 PM] Navigating to Creative Workspace login page
[1:09:04 PM] Homepage visibility: false
[1:09:04 PM] ℹ️ Typing query: "Suggest 3 books for childrens"
[1:09:34 PM] ⚠ ⚠Book Genie mode did not loaded
[1:09:34 PM] ℹ️ Preparing to type query: "Suggest 3 books for childrens"
[1:09:34 PM] ℹ️ Waiting for chat input to be visible
[1:09:34 PM] ℹ️ Clearing chat input
[1:09:34 PM] ℹ️ Typing query: "Suggest 3 books for childrens"
[1:09:35 PM] ℹ️ Pressing Enter to submit query
[1:09:35 PM] ✅ Query submitted successfully: "Suggest 3 books for childrens"
[1:09:35 PM] ℹ️ Waiting for AI to complete thinking...
[1:09:35 PM] 📋 WAITING FOR AI RESPONSE
[1:09:35 PM] ℹ️ Looking for AI thinking indicator...
[1:09:35 PM] ℹ️ Waiting for thinking indicator to appear (max 2 minutes)
[1:09:37 PM] ✅ ✓ AI thinking indicator appeared - AI is processing the request
[1:09:37 PM] ℹ️ Waiting for thinking indicator to disappear (max 5 minutes)
[1:09:53 PM] ✅ ✓ AI thinking completed - Response should be ready
[1:09:53 PM] ℹ️ 🔍 Checking for "None of the above, just" option...
[1:09:53 PM] ℹ️ ✓ "None of the above, just" option not present - proceeding normally
[1:09:53 PM] ℹ️ Allowing additional time for response rendering
[1:09:56 PM] ✅ AI response wait process completed
[1:09:56 PM] ℹ️ Validating response for query: "Suggest 3 books for childrens"
[1:09:56 PM] 📋 VALIDATING RESPONSE FOR QUERY: "Suggest 3 books for childrens"
[1:09:56 PM] ℹ️ Locating the latest response in chat
[1:09:56 PM] ℹ️ Waiting for response to be visible (max 30 seconds)
[1:09:56 PM] ✅ Response received - Length: 90 characters
[1:09:56 PM] ℹ️ Response preview: Watch Me Work✅ Request Processed🚀 Switching to BookGenieSure. Opening the BookGenie mode....
[1:09:56 PM] ℹ️ Extracting book data from response...
[1:09:56 PM] 📋 EXTRACTING BOOK DATA FROM RESPONSE
[1:09:56 PM] ℹ️ Locating BookGenie response container
[1:09:56 PM] ℹ️ Extracting HTML content from response
[1:09:56 PM] ℹ️ HTML content extracted - Length: 5823 characters
[1:09:56 PM] ℹ️ Parsing HTML to extract book data
[1:09:56 PM] ✅ SUCCESSFULLY EXTRACTED 0 BOOKS
[1:09:56 PM] 📋 EXTRACTED BOOKS SUMMARY
[1:09:56 PM] 📊 Total books extracted: 0
[1:09:56 PM] 📊 Average relevance score: 0%
[1:09:56 PM] ✅ Extracted 0 books from response